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Abstract 

In  this  paper,  we  investigate  one  of  the  possibilities  to  adapt  an  unbiased  moving  average 
(MA)  filter  (finite  impulse  response  [FIR]  filter)  to  the  slope  of  time  error  function.  The  lin¬ 
ear  regression  coefficient  is  used  as  a  statistical  estimator  of  sample  slope.  We  evaluate  the 
error  of  the  slope  estimate  and  present  two  options  for  the  adapting  coefficient  determination. 
To  examine  them ,  we  generate  the  time  error  noisy  signal  with  linear  trend  and  estimate  it 
with  a  simple  MA,  the  optimally  unbiased  MA,  and  the  two  adapted  filters.  The  particular  er¬ 
rors  of  the  fitters,  namely  bias,  RMSD,  RMSE  and  maximal  error  are  then  compared.  Finally 
we  mark  special  features  of  the  linear-regression-based  adaptation . 


INTRODUCTION 

Fast  and  extremely  accurate  “on-line”  GPS-based  estimating  of  time  errors  in  timekeeping  is  probably  the 
noblest  example  of  the  optimal  filtering  application  in  Time  and  Frequency.  Estimation  deals  here  with 
the  time  error  function  of  local  clock,  which  demonstrates  some  special  features,  which  are: 

•  Its  deterministic  model  seems  to  be  quadratic  at  least,  since  it  is  formed  with  an  initial  constant  error 
(xo),  an  initial  frequency  offset  of  local  oscillator  for  the  reference  one  (y0),  and  a  linear  aging  compo¬ 
nent  (D)  of  local  oscillator. 

•  Its  noise  fits  well  white  Gaussian  noise  (note:  the  more  noise  is  whitened,  the  more  accurate  linear 
optimal  estimate  is  achieved). 

Such  properties  of  the  time  error  function  allow  applying  the  linear  optimal  filtering  theory  (linear  Kal¬ 
man  filtering)  straightforward  to  recent  studies  [1]  have  showed  that  for  the  sake  of  accuracy,  it  is  not 
enough  just  to  use  the  three-space-state  Kalman  filter  totally  matched  with  the  above-mentioned  clock 
time  model.  The  known  computation  problem  here  is  noise  produced  by  the  state  space  discrete  time 
Kalman  filter  (the  more  states,  the  more  noise).  On  the  other  hand,  both  the  realizable  Wiener  and  the 
simple  moving  average  (MA)  filters  inherently  produce  the  bias  for  the  nonstationary  processes. 

In  our  report  [2],  we  show  that  of  the  filters  with  the  same  time  constant  an  optimally  unbiased  MA  filter 
(finite  impulse  response  [FIR]  filter)  produces  noise  lower  then  the  three-state  Kalman  with  rather  the 
same  bias.  However,  the  noise  is  bigger  than  that  of  the  simple  MA.  Knowing  that  a  simple  MA  pro¬ 
duces  the  lowest  possible  noise  among  all  the  filters  [3]  and  zero-bias  for  the  stationary  process  (y0  =  0 
and  D  =  0),  we  then  wonder  if  it  is  possible  to  adapt  the  filter  [2]  to  the  slope  of  the  time  error  function? 
In  other  words,  can  we  design  the  unbiased  MA  filter  with  the  same  smallest  noise  as  that  of  a  simple 
MA?  The  answer,  unfortunately,  is  not  exhaustively  positive. 
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In  this  report  we  examine  one  of  the  possibilities  to  reduce  the  estimate  error  using  a  linear  regression 
coefficient  as  an  estimator  of  a  time  error  slope.  We  work  out  the  adapted  filter  with  two  possible  adapt¬ 
ing  coefficients  and  study  it  for  the  generated  noisy  time  error  process  with  a  linear  deterministic  trend. 


ADAPTATION  OF  THE  OPTIMALLY  UNBIASED  MA  FILTER 


Given  the  optimally  unbiased  MA  Filter  [2] 


£=}  2(2N  - 1)  -  6i  t 

S  mn*b  1 


(1) 


where  N  is  a  number  of  the  points  in  the  average,  <t)n  is  observation,  and  xn  is  estimate  of  the  time  error 
x„.  Present  the  filter  (1)  in  a  form  of 


(2) 


where  k„  in  this  case  is  unity,  and  the  weighted  function  is 
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9 
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Now  analyze  this  form  (2).  Since  an  observation  on  the  averaging  interval  of  N  points  exhibits  the  sta¬ 
tionary  nature  and  a  simple  MA  is  best  here  in  a  sense  of  LMS,  then,  to  get  the  same  minimal  mean- 
square  error  (MSE)  for  the  filter  (2),  the  coefficient  should  be  taken  as  kn  =  0  to  get  from  (2)  a  simple  MA 
filter,  this  is 


N 


N-l 

I An-, 


1=0 


(4) 


On  the  contrary,,  once  the  observation  £n  is  a  brightly  pronounced  nonstationary  process,  then  the  opti¬ 
mally  unbiased  MA  solution  (1)  is  preferable  and  the  coefficient  then  is  kn  =  1  to  get  (1)  from  (2). 


Taking  unto  consideration  the  matter  of  fact  that  a  sample  slope  bn  of  the  actual  time  error  xn  function 
characterizes  its  nonstationarity,  we  show  that  an  adaptation  task  reduces,  in  fact,  to  determination  of  the 
dependence  kn(bn). 


AN  ANALYSIS  OF  FILTERING  ERRORS 

In  our  previous  report  [1],  we  estimated  the  time  error  modeled  as  [4] 

*  °*2  2 

x„=x0  +  y0bn  +  —isn  +  w„. 


(5) 
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where  n  =  0,  1,  ....  A  =  tn  -r„_,  is  sample  time,  tn  is  current  discrete  time,  and  wm (t)  is  random  time 

error  deviation  component.  We  then  showed  that,  for  the  same  time  constant,  the  estimate  error  of  the 
three  filters,  namely  a  simple  MA,  the  2nd  order  Wiener,  and  the  3-state  Kalman  differ,  depending  on  the 
signal  nonstationarity.  We  have  also  shown  that,  depending  on  y0,  the  application  range  for  all  three  fil¬ 
ters  may  be  separated  in  the  following  way: 

•  Simple  MA  is  most  accurate  for  0  <  y0  <  rx , 

•  2nd  Order  Wiener  filter  is  most  accurate  for  rx  <  y0  <  r2, 

•  3-State  Kalman  filter  is  most  accurate  for  r2<  y0, 
where  reference  values  rx  and  r2  are  defined  in  by 

rl2  =  oc1i2ct 

where  a2  is  variance  of  the  observation  noise,  0  is  the  same  time  constant  of  each  filter,  cti  is  coefficient 

dependent  on  impulse  response  of  the  Wiener  filter,  and  is  coefficient  dependent  on  impulse  response 
of  the  Wiener  and  Kalman  filters.  Yet  otj  and  0C2  either  depends  on  the  estimate  error  criterion.  Let  us 
mark  here  that  theoretical  determination  of  ai  and  a2  is  in  fact  a  not  trivial  task,  since  one  first  must 
evaluate  the  discrete  time  error  of  each  filter  for  the  given  time  constant.  Experiment  also  provides  the 
result  in  the  routine  way  [1]. 


We  now  would  like  to  use  the  same  approach  to  determine  the  separating  coordinate  (6)  for  the  simple 
MA  (4)  and  unbiased  MA  (1)  filters.  In  a  linear  case  of  (5),  this  is  D  =  0;  a  simple  MA  produces  the  bias 
biassMA  =O.5yo0  and  the  variance  o)m  =a2nl N  .  Under  the  same  condition,  the  unbiased  MA  filter  [2] 

for  1  «  N  produces  zero  bias  and  the  variance  a2uMA  =  4a2n  /  N .  Examining  an  equality  of  the  MSEs  of 


both  filters,  this  is 


4  °  N  N 


(7) 


we  determine  the  coordinate 


r  —  2a/3ct„ 


aajns]. 


1  A  [s] 

ns 

|  &\[hour3] 

hour  _ 

yron[nsl 


A  [s] 


Q\[hour] 


[l0'u]. 


(8) 


where  a  =  0.0577  is  used  if  one  works  in  ns/hours  and  yr  =  0.01604  if  in  parts  of  1012.  It  is  clear  now 
that  if  |y0|  <r,  then  a  simple  MA  is  best,  and  once  r  <  |y0| ,  then  the  unbiased  MA  must  be  applied. 


Of  course,  if  we  know  y0  implicitly,  then  the  filter  (2)  adapted  under  the  aforementioned  criterion  (8)  is 
best  in  a  sense  of  minimal  MSE  independently  on  the  time  error  function.  However,  we  do  not  know  it 
and  should  estimate  y0  in  some  approximate  way.  The  sample  n-th  frequency  offset  yo„  of  time  error  func¬ 
tion  is  in  fact  its  slope,  which  is  readily  estimated  stochastically  by  the  regression  coefficient 


5>o„  = 


Cov(4„,r„) 


(9) 


where  both  a  sample  covariance  of  the  observation  and  time  and  a  sample  time  variance  are  determined  in 
[2]  for  the  model  (5)  in  the  forms  of,  respectively. 
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(10) 
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Then  transformation  of  (9)  with  account  of  (10)  and  (11)  yields 


y0n  = 
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(12) 


Now  define  the  error  of  the  time  error  slope  estimate  for  the  linear  case  (5)  of  x0  =  0 , 
=y0A(n-i)+wB_t  and  y0a  =  y0,  and  get 


£»„  =y0-yo„  =y0~ 


12 
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that  easily  transforms  to 


yn 


12 


AN(Nz-l)tS 


I-' 


(13) 


(14) 


Since  the  noise  wn  is  white  by  definition,  then  it  follows  from  (14)  that  the  average  error  E{eyn }  =  0 ,  and 
the  error  variance  is  given  by 


<=E{e2}  = 


144 


N- 1  N-l 


A lNl{Nl  -If  [S§,:/VV"“,Wn'J 
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(15) 


(=0  j=0 


i=0  0 


Again,  since  noise  is  white  then,  by  definition,  E{wlw] } 
transfers  to 


_  I CT«’  1  J  it  means  that  a2  =  a2  and  (15) 
I  0,  i  ^  j 


2  2 

cr  =  ct„ 


12 


y  »  a  2 


A2A(AT-1) 


(16) 


If  we  take  into  account  now  that  0  =  A (N  - 1)  and  A  «  x  for  1«  N,  then  RMSE  of  (16)  transforms  to  the 
same  formula  like  the  case  of  the  coordinate  r  (4),  namely 


a 


y 


(17) 


It  means  that  regression  produces  appreciable  RMS  error  of  the  slope  estimate,  which  equals  to  the  esti¬ 
mate  of  a  coordinate  r. 


ADAPTATION  STRATEGY 

We  now  can  consider  how  to  describe  the  coefficient  kn(y0n)  for  (2).  The  first  case  is  we  just  think  that 
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(18) 


(o  if  y0n  - r  ^ 

[l  if  r<y0n' 


Actually,  this  is  an  ideal  case  of  the  slope  estimated  with  negligible  error.  Since,  according  to  (12),  the 
error  is  rather  big,  then  we  may  introduce  an  additional  weight  for  (18)  to  smooth  the  estimate.  To  form 
this  weight,  let  us  assume  the  coefficient  kn(y0n)  to  be  changing  linearly  in  some  range  rx<r<r2  around 
r.  The  second  case  then  appears  in  a  form 


k 


n 


o.  f  y0„  <  ri 

+  y0„  — —  f  n  ^  y0n  ^  r2 

2  ~ri  h  ~  r\ 

1  if  r2<  y0n 


(19) 


and,  if  to  take  rx  =  r  -  O  y  and  r2  =  r  +  a  y ,  where  oy  is  provided  by  (17),  we  get  the  alternative  coeffi¬ 
cient  for  (2). 


SIMULATION 

In  this  section  we  examine  the  adapted  filter  (2)  with  two  above-defined  coefficients  (18)  and  (19).  Pur¬ 
suing  the  aim,  we  simulate  the  discrete  time  error  process  (5)  with  x0  =  0,  y0  =  var,  D  =  0,  A  =  100  sec, 
CTn  =  40  ns,  and  0  =  6  hours  ( N  =  216).  We  then  calculate  the  reference  point  (8);  this  is  r  =  0.436xl0'12. 
Because  frequency  offset  yo  strongly  influences  the  estimate  error,  we  change  it  around  the  reference 
point  from  0  to  2.0xl0'12,  watching  in  this  way  the  filter’s  adaptive  facilities. 

To  compare  the  results,  we  define  the  estimate  error  as  follows 

<20> 

where  x"  =  y0An  is  simulated  deterministic  trend  of  a  time  error,  xn  is  estimate  of  a  time  error.  We  then 
evaluate  (20)  for  a  number  M  of  estimates  by  the  particular  sample  errors  such  as  bias  Ac  =  #{£„},  vari¬ 
ance  ct2  =£■{(£„  —Ac)2},  root-mean-square  deviation  (RMSD)  ae  =  ,  RMS  error  (RMSE) 

eRMs  =  ^{e2}  =^Ac2+a2  ,  and  maximal  error  emM  =  max|e„| . 

Figure  1  shows  the  bias  produced  by  each  filter  along  with  the  ideal  adaptation  curve.  As  it  had  been  ex¬ 
pected,  a  simple  MA  (4)  produces  the  biggest  bias  and  the  optimally  unbiased  filter  (1)  is  best  with  its 
almost  zero  bias.  The  dotted  line  shows  here  the  ideal  case  of  adaptation,  because  for  y0  <  r  we  would 

like  the  filter  to  be  a  simple  MA  and  for  r  <  y0  the  optimally  unbiased  MA.  Because  the  error  (17),  we 
expect  as  well  that  the  ideal  case  cannot  be  reached  and,  in  fact,  both  adapted  filters  demonstrate  strongly 
smoothed  lines.  Yet,  the  coefficient  k 'produces  a  bit  smaller  bias  than  that  achieved  with  k" .  We  then 
conclude  that  in  terms  of  bias,  the  optimally  unbiased  filter  (1)  remains  best  for  an  arbitrary  offset  y0  • 

Figure  2  sketches  the  RMS  deviations  of  the  estimate  noise.  In  contrast  to  bias,  here  a  simple  MA  is  best 
with  its  lowest  constant  noise;  the  unbiased  filter  generates  almost  two  times  bigger  noise,  so  the  ideal 
adaptation  case  looks  like  a  step  function  at  the  point  of  r  (dotted  line).  As  well  as  in  a  bias  case,  here 
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both  adapted  curves  are  also  smoothed,  so  that  only  in  the  range  of  y0  <  r  the  adapted  filters  generate 
noise  lower  than  the  unbiased  filter  does.  In  the  range  r  <y0  the  adaptation  is  no  superior.  The  conclu¬ 
sion  is  the  linear-regression-based  adaptation  is  not  so  efficient  with  respect  to  the  estimate  noise. 

Figure  3  shows  RMS  error  of  each  filter.  Again,  as  well  as  in  the  case  of  RMSD  (Figure  3),  we  see  here 
that  the  errors  of  the  adapted  filters  in  the  range  y0  <  r  are  smaller  than  that  produced  by  the  optimally 

unbiased  filter.  In  the  range  r  <  y0 ,  however,  both  adapted  filters  are  worst. 

Figure  4  exhibits  curves  for  the  maximal  estimate  errors.  Despite  the  error  of  the  second  adaptation,  case 
(19)  is  smaller  than  that  of  the  unbiased  filter  in  the  range  left  of  the  point  r;  we  also  come  to  the  conclu¬ 
sion  that  effectiveness  of  the  adaptation  is  poor.  It  is  because  in  the  range  right  of  the  point  r,  the  error  of 
each  adapted  filter  is  even  bigger  than  that  of  the  unbiased  filter. 


CONCLUDING  REMARKS 

We  have  examined  in  this  report  one  of  the  possibilities  to  improve  the  optimally  unbiased  filter  by  adap¬ 
tation  to  the  time  error  function  slope.  The  idea  was  to  introduce  for  the  filter  an  additional  adapting  coef¬ 
ficient  k  dependent  on  the  function  slope,  so  that  for  the  stationary  process  (yo  =  0)  we  assume  k  =  0,  and 
for  the  brightly  nonstationary  process  (r  «  yo)  we  suppose  k  =  1 .  Then  we  estimated  the  slope  by  the 
regression  coefficient,  evaluated  the  slope  estimate  error,  worked  out  the  adaptation  strategy  (18)  and 
(19),  and  examined  the  filters  for  the  noisy  time  error  function  with  linear  trend.  The  conclusions  are  fol¬ 
lowing: 

•  In  terms  of  bias,  the  adapted  filters  are  not  superior  to  the  optimally  unbiased  MA  filter. 

•  In  terms  of  RMSE  and  Maximal  error,  adaptation  produces  noise  smaller  in  a  range  y0  <  r  and  big¬ 
ger  in  a  range  r<y0. 

The  general  conclusion  is  the  linear  regression  based  approach  to  the  filter  adaptation  exhibits  poor  effec¬ 
tiveness,  and  other  ways  to  estimate  the  slope  with  more  high  accuracy  are  needed. 
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Figure  1.  Bias  produced  by  the  simple  MA,  optimally  unbiased  MA,  and  adapted  MA  filter  for  the  dis¬ 
crete  time  error  linear  process  (1)  with  x$  =  0,  y0  =  var,  D  =  0,  A  =  100  sec,  an  =  40  ns,  and  0  =  6  hours 
(A  =  216). 


Figure  2.  RMSD  of  the  simple  MA,  optimally  unbiased  MA,  and  adapted  MA  filter  for  the  discrete  time 
error  linear  process  (1)  with  x0  =  0 ,y0  =  var,  D  =  0,  A  =  100  sec,  on  =  40  ns,  and  0  =  6  hours  (A  =  216). 


423 


Figure  3.  RMSE  of  the  simple  MA,  optimally  unbiased  MA,  and  adapted  MA  filter  for  the  discrete  time 
error  linear  process  (1)  with  x0  =  0,  y0  =  var,  D  =  0,  A  =  100  sec,  on  =  40  ns,  and  0  =  6  hours  (N  =  216). 


Figure  4.  Maximal  error  of  the  simple  MA,  optimally  unbiased  MA,  and  adapted  MA  filter  for  the  dis¬ 
crete  time  error  linear  process  (1)  with  x0  =  0,  y0  =  var.  D  =  0,  A  =  100  sec,  Gn  =  40  ns,  and  0  =  6  hours 
(A  =216). 
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